Self-checkout method and apparatus

ABSTRACT

A point-of-sale self-checkout terminal includes a code reader device for automated entry of a product identification code present on items for purchase and a customer input device for receipt of data from a customer. A customer oars initiate a purchase of a non-scannable item and, in response, a database is queried to identify items based on a prediction of purchase of the items, and the identified items are displayed for selection by the customer to purchase the item. Image processing and voice processing, can also be implemented to assist customers with the purchase of non-scannable items.

CROSS REFERENCE TO RELATED APPLICATION

The present application is a divisional of non-provisional Ser. No.12/775,861, tiled May 7,2010, now published, which is a divisional ofnon-provisional Ser. No. 10/150,148, filed May 17, 2002, now published,which is a continuation-in-part of Ser. No. 09/710,137, lied Nov. 10,2000, the disclosure of which Is hereby Incorporated by reference in itsentirety, claiming the benefit of provisional application 60/244,234filed Oct. 30, 2000.

FIELD OF THE INVENTION

The present invention relates to a method and apparatus forself-checkout. In particular, the invention relates to a method of andapparatus for self-checkout of non-bar coded items which Includes usinga graphic user interface (GUI) on a touch screen display.

BACKGROUND OF THE INVENTION

In a traditional retail environment, a customer selects various itemsfor purchase and brings these items to a store clerk for checkout. Overthe past few decades, retail point of sale systems have been greatlyautomated to expedite the checkout process. Computer-based point-of-salesystems are now the norm in the retail environment.

Such point-of-sale systems include one or more terminals, and a databaseof prices, inventory and other information related to the items forpurchase. Each terminal typically has an optical scanner which scans theitems to be purchased for a machine readable bar code that identifiesthe item on its packaging. When an stem is scanned, the optical scannersends a signal corresponding to the product number of the item to a dataprocessing component of the point-of-sale system, which then obtainsfrom the database the price and the description of the scanned item.

More recently, self-checkout point-of-sale systems have beenpopularized. These systems typically comprise self-checkout terminalseach of which typically is provided with a bar code scanner with anintegrated scale that allows the customer to scan the bar codes on theitems to be purchased. The terminal typically also has other input andoutput devices such as a printer, electronic fund transfer terminal(EFT), a video camera unit and a display.

Automated self-checkout systems, such as the U-Scan Express® availablefrom Optimal Robotics Corp., have become popular among retailersthroughout North America. Some self-checkout systems are described inU.S. Pat. Nos. 5,083,638, 5,115,888, 5,123,494, 5,125,466 and 5,168,981.

In the typical retail market, most produce items, as well as other itemssuch as items priced according to weight but usually mi having astandardized weight, do not have a Universal Product Code (UPC), in theform of a bar code, associated with them. A Product Look Up (PLU) codeis assigned instead to such Items. The PLU code corresponds to a numericidentification of the item and, in most cases, is attached to the itemwith a sticker.

The non-bar coded item typically is checked out by the item being placedon the scale at the checkout station, if the item is priced according toweight, and then the PLU code of the item being entered by the customerat the self-checkout station, or by the cashier at a manned checkoutstation, using the numeric keypad. The processing unit then assigns aprice to the item based on the PLU code and, if applicable, the weightof the item detected by the scale. Many customers at such self-checkoutstations do not know, however, that they need to enter manually the PLUcode for such items, and therefore such customers experience delay inthe checkout process.

At a self-checkout terminal, the customer is provided means to call forassistance from a supervisory employee when a non-bar coded item is tobe processed, in some Implementations, a video camera unit at theself-checkout terminal captures a video image of the uncoded item placedon the terminal's scale by the customer. The video image of the uncodeditem is displayed at a supervisor station display which allows thesupervisory employee to view the non-bar coded Item and thereafter enterthe appropriate PLU code for the item. This employee typicallysupervises, however, several selfcheckout terminals, and therefore thecustomer might encounter delay wasting for a non-bar coded stem to beprocessed.

SUMMARY OF THE INVENTION

The present invention provides an apparatus and method for self-checkoutof non-bar coded items, The apparatus includes a PLU entry device, a PLUdatabase and a NYB processing unit. The PLU entry device includes adisplay and a GUI. The GUI provides on the display a predetermined imagecorresponding to a non-bar ceded item, and means for the user to selectthe predetermined image of the non-bar coded item. The PLU entry devicesupplies a PLU corresponding to the non-bar coded item selected by theuser. The processing unit uses the PLU supplied by the PLU entry deviceto retrieve the price per pound or per unit of the selected non-barcoded item from the PLU database. This data can be used to calculateprice in relation to the weight or quantity of the item.

The apparatus may Include a GUI editor. The GUI editor may be used toconfigure the GUI for non-bar coded items.

The processing unit may maintain for each item a count of the number ofunits of the item sold within a predetermined period of time. Theprocessing unit also may maintain a list of most frequently sold items,and the image of at least one item on the list may be provided on aselected display screen. The processing unit may update the displayscreen when the list of most frequently sold items changes; Using astatistical prediction algorithm, the processing unit may also suggestto the user to purchase certain items that are commonly purchased withthe items that the user has already decided to purchase. The statisticalprediction algorithm may use various data, including, but not limitedto, the characteristics associated with the purchased item.

An image of a generic category of items may be provided on the display.The displayed image of the generic category may be selected by the userto view images of respective Items in the generic category.

BRIEF DESCRIPTION OF THE DRAWINGS

The present Invention can be more readily understood from the followingdetailed description by referring to the accompanying drawings wherein:

FIG. 1 shows an exemplary image of a non-bar coded item selection GUIthat can appear on a touch screen monitor for selecting a genericcategory of items;

FIG. 2 shows an exemplary GUI screen for selecting one of specific typesof apples;

FIG. 3 shows an exemplary GUI screen presenting maintenance modeoptions;

FIG. 4 shows an exemplary GUI screen for entering a password;

FIG. 5 shows an exemplary GUI screen for entering an alternate password;

FIG. 6 shows an exemplary GUI screen presenting custom setup options;

FIG. 7 shows an exemplary GUI editor screen presenting edit options;

FIG. 8 shows an exemplary GUI editor screen for selecting a resetfrequency for the database of most frequently sold items;

FIG. 9 shows an exemplary GUI editor screen for selecting a day of theweek upon which the database is to be reset;

FIG. 10 shows an exemplary GUI editor screen for selecting visual layoutof the GUI for non-bar coded items;

FIG. 11 shows an exemplary GUI editor screen for selecting a button towhich an item or generic category may be assigned;

FIG. 12 shows an exemplary GUI editor screen for selecting a type of anitem to be assigned to the selected button;

FIG. 13 shows an exemplary GUI editor screen for selecting a thirdbutton to be defined;

FIG. 14 shows an exemplary GUI editor screen for selecting a specificitem to assign to a button;

FIG. 15 shows an exemplary GUI editor screen indicating selection of anorganic fruit/vegetable;

FIG. 18 shows an exemplary GUI editor screen informing that an incorrectPLU code was entered;

FIG. 17 shows an exemplary GUI editor screen for selecting a fourthbutton to foe defined;

FIG. 18 shows an exemplary GUI editor screen for selecting a genericcategory to be assigned to a selected button;

FIG. 10 shows an exemplary GUI editor screen for selecting a genericcategory;

FIG. 20 shows an exemplary GUI editor screen for selecting a fifthbutton to be defined;

FIG. 21 shows an exemplary GUI editor screen for selecting a button tobe assigned in the submenu;

FIG. 22 shows an exemplary GUI editor screen for selecting an item toassign to the selected button in the submenu;

FIG. 23 shows an exemplary GUI editor screen for selecting an Item toassign to a second button in the submenu;

FIG. 24 shows an exemplary GUI editor screen for selecting a thirdbutton to be assigned in the submenu;

FIG. 25 shows an exemplary GUI editor screen for presenting a warning ifa selected button has been assigned to a generic category with apre-defined submenu;

FIG. 26 shows an exemplary GUI editor screen for confirming removal of aselected button;

FIG. 27 shows m exemplary screen in the GUI for nor-bar coded-items;

FIG. 28 shows an exemplary screen in the GUI for non-bar coded itemswhen a generic category button is selected;

FIGS. 29A and 29B show a flow chart for a process, in accordance with anembodiment of the present invention, of setting up a non-bar coded ItemsGUI

FIG. 30 shows a block diagram of a self-checkout system.

FIGS. 31-35 show exemplary screens of the GUI for non-bar coded itemswith alphanumeric lookup.

FIG. 38 shows data stored in exemplary database records.

FIG. 37 shows an interface allowing a store manager to customize theitems that may be selected by the user.

DETAILED DESCRIPTION OF THE INVENTION

Improvements in the operation and usability of point-of-saleself-checkout systems can be provided by a self-checkout system thatincludes a scanning device for automated scanning of bar-coded items aswell m a customer-operated interface for checkout of items that are notcoded for scanning. The customer-operated interface, can be a graphicaluser interface (GUI) (a “non-scannable item GUI”) that may includefeatures such as a touch-screen display and input device, iconicrepresentations of items for purchase, and search facilities to helpIdentify items being purchased and to enter appropriate checkout data.An editor for provisioning data and setting up various, features of thenon-scannable item interface can also be provided. The checkout system,and in particular, the non-scannable item GUI, can be used for checkoutof items such as produce and bakery items in a grocery sales environmentand for non-scannable items in other retail environments. To do so, aflexible method of provisioning data and icon images associated with thenon-scannable items is provided.

FIG. 30 shows a block diagram of an implementation of a point-of-saleself-checkout station that includes a non-scannable item GUI. Theself-checkout station 300 includes a processing unit 301 which may beconfigured similar to known microprocessor-based computers and has acentral processing unit (CPU), a plurality of storage devices, aninput/output (I/O) interface and a network interface. The storagedevices may include program memory, random access memory (RAM),non-volatile memory, read-only memory (ROM), electrically erasableprogrammable ROM (EEPROM), etc., and any or a combination of the massstorage devices known conventionally in the art, such as floppy disk,optical disk, hard disk and/or tape cartridge drives, plus appropriatedevice drivers. The CPU communicates via the I/O interface with a PLUdatabase 303, one or more scales 304, a touch-screen display 302 (orother entry device, such as a touchpad), and a bar code scanner itemsmay include other types of machine-detectible identification encodingsinstead of, or in addition to, scannable bar codes (e.g., magneticencodings, magnetic transducers, and other machine-readable printedcodes). Consequently, implementations may be equipped with other typesof reader devices to detect encoded product identifications (IDs), e.g.,magnetic sensors to read magnetic encodings, and other types of scanningsensors for other printed code types.

The self-checkout station (i.e., processing unit 301) also can include anetwork Interface used for communication over a network (e.g., a localarea network, wide area network (WAN), wireless and other networks) withother devices. These other devices may include a host computer, such asa store's central controller, and may also include other checkoutstations and supervisory stations. The network interface includes theappropriate units for interfacing with the network, including, forexample, Ethernet card, modem, radio frequency (RF) transceiver, etc.For example, processing unit 301 may download product and otherinformation from a central point-of-sale database on the network, onpower-up as well as periodically during operation, via the networkinterface. Thus, the PLU database 303 stored in the storage devices maybe updated.

Self-checkout orders commonly include a combination of scannable (i.e.,bar-coded) and non-scannable items. To purchase a scannable item, thecustomer moves the item past an automated scanning device which readsthe scannable product identifier and thereby determines the item'sidentification. If the customer wants to purchase a non-scannable item,the customer may do so by entering of a product identifier using thenon-scannable item interface. This product identifier can be receivedthrough the entry of an alpha-numeric identifier, an icon selection, orby a combination of these methods (the chosen mechanisms may differ indifferent implementations). In some implementations, speech and visualinputs may be processed by the self-checkout system to assist inidentifying a produce.

FIGS. 1-2 and 31-35 show customer interface screens displayed in twoexample implementations (implementation #1 and #2) of non-scannable itemGUIs. Each of the example implementations uses an interactivetouch-screen display 302 combining a touch-sensor screen 302 b and acathode ray tube (CRT), liquid crystal display (LCD), or other graphicaldisplay element 302 a for customer interaction, implementation #1 (FIGS.1-2) includes a on-screen numeric keypad 182 for the entry of productlookup (PLU) codes, and displays interactive icons 191 that can be usedto select an item from system determined initial grouping of products.The system-determined grouping is a grouping that is determined separatefrom an explicit search request by a customer for a desired item.Examples of system-determined groupings include predetermined groupingand predicatively determined grouping (e.g., a grouping offrequently-purchased non-scannable items). Implementation #2 (FIGS.31-35) also includes a on-screen numeric keypad 3102, as well as asystem-determined Initial group of interactive icons 3201,Implementation #2 also includes a alphabetic keyboard interface 3204used to enter search terms so that the customer can locate and selectproducts in addition to those shown in the Initial group 3201, Theself-checkout system's non-scannable item GUI Is accessed when thecustomer wishes to purchase a non-bar-coded item. Access to theInterface may be triggered when the customer places an unscanned item:on a scanner scale, or by explicit selection of a on-screen control fromthe display 302 (e.g., a button labeled “Purchase Item Without A BarCode).

When the non-scannable item GUI is activated, a PLU entry screen 100,3100 may be displayed. As shown in screen 100 of implementation #1, thecustomer can identify an item by PLU code entry using a graphicaltouch-screen keypad 192. If the item is displayed in the grouping 191,the customer can also select the appropriate Item to enter the purchase,in some implementations, icons 191 display images representing a genericcategory and selection of the generic category's icon will provide amore detailed sub-menu. If the item is not labeled with a PLU code, andan appropriate icon 191 is not displayed, the user may select the “NoLabel” button 103 to obtain assistance from store personnel, interfacescreen 3100 of implementation #2 also permits entry of a PLU code usinga graphical touch-screen interface, if the item is not labeled with aPLU code, the user can select the “No Label” button 3103 to access asecond interface screen 3200 (FIG. 32). Interface screen 3200 initiallydisplays the system-determined loon grouping 3201 as well as anon-screen keyboard 3202, icons initially displayed in 3201 can be bestseller or most frequently sold items, and this information can bedisplayed as soon as the screen is displayed. If the purchase item isshown by an icon 3201, the user may select that icon to purchase theitem, otherwise keyboard 3204 may be used to enter terms used to searcha product database 303 and locate the desired item.

To locate a desired item, keyboard 3204 is used to provide alphabeticcharacter input (or, in some implementations, expanded input sets suchas alpha-numeric) to the checkout system. The checkout system receivesthe input characters, parses the input into search terms, queries aproduct database, and display results as user-selectable icons.Referring to FIG. 33, as letters are entered on the keyboard 3204, theyare displayed in a display area 3305 and matching products aredetermined based on the entered characters and displayed as icons 3301displayed on the Interface 3300. As additional letters are entered, thedisplay area 3301 is again updated to reflect the additional input(compare the icons of FIG. 33 which are displayed after the entry of theletter “P” with the icons of FIG. 34 which are displayed after thefurther entry of the letter “E”).

To identify the matching products, the checkout system parses inputcharacters to form search terms and uses those terms to query thedatabase 303 and thereby locate matching items. The search termsincluded In the query can include words (i.e., a group of contiguousletters delimited by a space character) as well as a word fragment(i.e., a group of contiguous letters not yet delimited by a spacecharacter). Querying database 303 includes comparing each of the searchterms to keywords associated with each product. The item-keyworddatabase may be stored in a local database 303 or a central database(e.g., a store controller database). FIG. 36 shows example item-keywordrecords for a number of products. As shown in FIG. 38, for each product,the database stores an icon 3601, a PLU number 3602, a descriptors 3603that may be used by other store systems (e.g., by a store's mastercontroller), and keywords in one or more languages (e.g., English 3604,Spanish 3605, and French 3606).

Preferably, the product query algorithm will match search terms to anitem's keywords regardless, of the relative ordering of the search termsand keywords. Further, a search term will match a keyword if the term ispresent as an initial substring of the keyword. Thus, the term “PearBos” will match “Bose Pears.” Additionally, implementations may providefor automatic conversion between plural and singular terms such that aterm entered by the user in the plural (e.g.., “pears”) will match akeyword expressed in the singular (e.g., “pear”). Conversion betweensingular and plural tenses may be done, e.g., by using a lookup table.In some implementations, a lookup table may also be used to convert aterm entered by a user into an alternative term or to expand art enteredterm into multiple terms. This conversion and expansion feature may beused, for example, to convert a regional product name to a standardterm, or where a product may be known by multiple terms (e.g., in ahardware store implementation, the search term “fastener” may beexpanded to the Boolean search expression “bolt or screw or rivet”).Where term substitution and/or expansion is employed, the display ofresults may be in accordance with an ordering that favors resultsmatching the specific terms entered, rather than the expanded orsubstitute terms. Furthermore, in some implementations, the processingunit may use a statistical prediction algorithm to suggest to the userto purchase certain items that are commonly purchased with the itemsthat the user has already decided to, purchase. The statisticalprediction algorithm may use various data, including, but not limitedto, the characteristics associated with the purchased item.

In some implementations, the icon display 3301 is automatically updatedas each letter is entered. In other implementations, the icon displaymay be updated when there is a pause in data entry (e.g., after a 500millisecond pause), or upon explicit request by the user (e.g.,selecting an “Enter” button). Implementations can also include scrollbuttons (e.g., buttons 3302) used to scroll the displayed icons when thenumber of items exceeds the available screen space. After the desireditem icon is displayed and selected, another screen (FIG. 35) may bedisplayed for the entry of quantify information using keypad 3501.

In the example implementations (#1 and #2), the system-determined Icons(191 30 and 3201, respectively) are displayed when the non-scannableitem GUI is accessed. These initial Icons sets 191, 3201 may be selectedbased on an expectation or probability that a particular items is to bepurchased. This expectation can be determined based on the frequency ofpurchase of particular items during a preceding period (e.g., during thepast month) in all customer orders, in other implementations, theinitial icons 191, 3201 may be customer specific and can be determinedbased on a customer's: specific sales history. The initial icon set canalso be determined based on other statistical/probabilistic factors. Forexample, the icons 191, 3201 may be determined based on a statisticalcorrelation that a particular item will be purchased when another itemhas already been entered as part of an order. For example, in a hardwarestore implementation, if copper piping has already been entered in anorder, the icons 191,10 3201 may correspond to non-bar-coded joints andfasteners used to connect copper piping.

In some implementations, the system-determined icons 191, 3201 can bedetermined, on a user-specific basis. To enable this feature, thedatabase 303 includes customer purchase history information. Followingreceipt of a customer Identification by the self-checkout system (e.g.,by the swiping of a bar-coded frequent-shopper card in front of ascanner; swiping of a credit or debit card entry, or using data entereddirectly by the customer), the database 303 is queried to determine theuser's purchase history. The icons 131, 3201 are then determined basedon the user's purchase history or other user-specific information.Correspondingly, at the end of order processing, customer purchase datamay be stored in the database 303 reflecting the newly purchased items,in other implementations, the sales history database may be implementedby data stored on the frequent-shopper card (e.g., using a magneticstrip or in “smart card” memory).

Implementations can include further refinements, such as the ability todetermine the frequently sold items on a seasonal basis, in suchimplementations, the database 303 can store customer purchaseinformation along with purchase dates so that seasonal buying patternscan be determined. Thus, for example, during the week before Halloween,icons for purchase of pumpkins may be displayed based on a customers'purchases of pumpkins during mat week of the previous year. Thisinformation may be stored without differentiating based on theparticular customers, or may be stored on a customer-specific basis,

The Icon grouping 191, 3201 may change continuously as a result ofongoing sales at the self-checkout terminals. For example, in afrequently-sold item implementation, the system automatically updatesthe images on the touch screen monitor for those buttons pre-defined asbuttons for most frequently sold items. The updating of the buttons maybe dynamic and may occur in between the processing of two orders at theself-checkout terminal, or may be at greater intervals (e.g., monthly orquarterly). The processing unit of each self-checkout terminal, or acentral database, may maintain an item count of every produce (ornon-bar coded item) sold, Checkout terminals may communicate to find thehighest count of produce (or non-bar coded) stems in their database.

As an example, the following may be a snapshot (in time) of informationstored in the databases corresponding to counts of produce (or non-barcoded) items sold at four respective self-checkout terminals in agrocery store:

Terminal 1 Terminal 2 Terminal 193 Terminal 4 Database Database DatabaseDatabase carrots = 156 lemons = 200 bananas = 760 cucumber = 6 peaches =48 tomatoes = 156 carrots = 155 bananas = 46

After the terminals have communicated amongst themselves, (or thepurchase information has been aggregated in a central data system) thefollowing results may be displayed on the touch screen monitor of eachof the self-checkout terminals:

Top 1 = bananas Top 4 = tomatoes Top 2 = carrots Top 5 = peaches Top 3 =lemons Top 6 = cucumbers

Each database record may also contain other information such as anexpected weight range, density range, and size information. Thisadditional data may be employed in enhanced versions of a self-checkoutsystem. Two such enhancements include the use of image processing andvoice recognition.

In an implementation that includes image processing, the system-selecteditems 191, 3201 may be selected based on analysis of an image of an itemas captured by a video camera 306. This image data may include thecolor, shape, size, texture, and number of items. For example, thecamera 306 may capture an image of one or more pieces of fruit placed onthe scale 304, process the image to determine candidate items, anddisplay those items on the non-scannable item interface. Technology forthe recognition of visual images is known (see, for example, U.S. Pat.Nos. 5,546,475; U.S. 5,831,978; U.S. 5,849.070; U.S. 8,005,959; and U.S.8,310,084 specifically addressing the recognition of images of produce).By applying such recognition system technology to the selection of agroup of candidate items, rather than merely for the final determinationof the product, the system 300 may provide for additional accuracy byincluding confirmation by the customer of the image processing results.

In some implementations of the system 300, criteria such as weight (asdetermined by the scale 304) and size or shape (as determined by imageprocessing) can be used together. For example, size, shape, and weightcan be used to calculate item density. This size, shape, weight,texture, color, and/or density information can be compared to datastored in the database 303 to further refine the selection; of icons191, 3201. For example, image processing may be used to determine thatan item placed on the scale 304 is a spherical item. Therefore, thesystem will only select items from database 303 where the database 303indicates that the items are spherical. In some cases, weight may beused to further distinguish item. For example, a melon and a head oficeberg lettuce may each have similar spherical shapes and sizes.However, at a given size, the weight of these two items, and thereforetheir density, will occupy different ranges and this data can be used asdistinguishing criteria. Once the CPU has made the item analysis, itwill display a suggestion of photo quality images of the non-bar codeditems on the self-checkout terminal's touch screen monitor 191, 3201. Ofcourse, if the image analysis does not yield a appropriate result, thecustomer may identify the item using the keyboard 3204 search method orPLU entry methods described of the system 300.

In some implementations, the image processing features may be used forsecurity purposes instead of, or in addition to, the use of imageprocessing for item selection. For example, the system may capture animage of a produce item, process that image to make an initialassessment of the item, and compare it to an item selection entered bythe consumer using the non-scannable item interface. If the itemselected by the consumer matches the recognition system's identificationof the item, the purchase is made. If there is a mismatch, an alert maybe sent to a monitoring station displaying the image captured by thesystem as well as the identification entered by the consumer. Theattendant at the monitoring station may then approve the transaction(e.g. where the consumer entered the proper identification but therecognition system assessment was inaccurate), or override theconsumer's item identification by accepting the recognition system'sassessment or by entering a correct item identification.

In some implementations, the system may be equipped with a voicerecognition system that can operate to identify non-scannable items.When a non-scannable item needs to be identified, the user may have anoption of speaking into a microphone 307 to identify the item. Thesystem can be programmed to recognize both specific and genericdescriptions of each item (e.g., “Apple” or “Granny Smith”), if ageneric identifier is specified, then the system may display iconscorresponding to the specific choices within the generic category.Preferably, speaker-independent voice recognition software will be usedto implement voice recognition capabilities. Further, the system may beprogrammed to identify multiple languages.

An editor for setting up the non-bar coded items GUI, in accordance withone embodiment of the present invention, will be described below inconnection with FIGS. 3-26 and 29.

A GUI editor may be provided as a tool for an administrator of theself-checkout system to set up the GUI for non-bar coded items. The term“administrator” is used herein to mean a person who has accessprivileges for configuring the GUI for non-bar coded items. Such personneed not be a computer specialist or expert, particularly when theperson has the benefit of a GUI editor such as the one described below.

Using the GUI editor, the administrator may select, and configure theterminals to show, the appropriate GM screens, such as those illustratedin FIGS. 1 and 2, for non-bar coded items.

Configuration of the GUI for non-bar coded items may be performed at,for example, one of the self checkout terminals in a maintenance mode.The maintenance mode screens at the self-checkout terminal allow theadministrator to use a GUI editor for setting up the screens forprocessing non-bar coded items. After configuration of the GUI fornon-bar coded items has been completed at the selected terminal, the GUIdata may be broadcast to the remaining self-checkout terminals in thestore on a LAN or wireless network, in order for the GUI for non-barcoded items to be installed on those terminals.

The selected checkout terminal on which the GUI for non-bar coded itemswill be configured enters a maintenance mode from one of a number ofpossible paths. For example, the terminal may enter the maintenance modeby default upon boot-up or by command from a shell or user interface.

An example of a GUI screen which may be displayed when the terminalenters the maintenance mode is illustrated in FIG. 3. The maintenancemode screen provides assorted user interface features for performingmaintenance at the terminal, including testing the various components ofthe terminal, such as the bill dispenser and the speaker. Moreover, theadministrator is provided with means, e.g., a graphic button/key, toenter custom setup of the terminal (step 102 shown in FIG. 29)

Custom setup is password protected, i.e., the user is required to entera password to enter custom setup. An example of a GUI screen forentering custom setup is illustrated in FIG. 4. The user may enter thepassword and select a “DONE” button on the touch screen monitor (step104). If the password is incorrect (step 106), a message asking the userto try again may appear on the screen, as shown for example in FIG. 5.

When the password is correct, the administrator is provided with anumber of custom setup functions by the GUI. The user interface providesmeans on the touch screen monitor, e.g., button identified as “ProduceEditor” in FIG. 8, for the user to select access to the GUI editor fornon-bar coded items (step 108). An additional password also may berequired for access to the GUI editor. The GUI again may prompt the userfor a password as shown for example in FIG. 4 (step 110).

After a correct password is supplied (step 112), the GUI editor providesthe 30 administrator with two edit options (step 114), as shown forexample in FIG. 7. The administrator may select the first option (shownin FIG. 7 as “Best-Seller Database Management”) to configure a databaseof specific features, such as the best seller items, described furtherbelow. The administrator may select the second option (shown in FIG. 7as “Layout Modification”) to configure a layout of the GUI for non-barcoded items.

When the administrator selects the first option, the GUI editor promptsthe administrator to select a frequency for resetting the database ofthe most frequently sold items (step 118), as shown for example in FIG.8. The frequencies that may be selected include, for example, daily,weekly, bi-weekly, monthly, etc. After the administrator selects theupdate frequency, the GUI editor prompts the administrator to select aday of the week on which the database is to be reset (step 118), asshown for example in FIG. 9.

After the administrator completes configuration of the best-sellerdatabase, the GUI editor provides the administrator with the editoptions again (FIG. 7). The administrator then may select the “LayoutModification” option. A number of possible visual layouts of the GUI fornon-bar coded items are displayed by the GUI editor for selection (step120), as shown for example in FIG. 10.

After one of the layouts is selected, the GUI editor prompts theadministrator to select one of the buttons to be defined in the GUI fornon-bar coded items (step 122), as shown for example in FIG. 11. Next,the GUI editor prompts the administrator to assign the selected buttonto an item or generic category (step 124). As shown for example in FIG.12, the button may be assigned to one of the following item/categorytypes: (i) a best seller; (ii) a specific produce item, e.g. kiwi; or(iii) a generic produce category, e.g., a family of fruits orvegetables.

For example, If “A Top 12 Best-seller Item” is selected (step 126), theselected button is assigned dynamically to the item that is currentlyhighest in the list of most frequently sold produce items at theself-checkout terminals (step 128). After the button is assigned to thebest seller item, the GUI editor prompts the administrator to select oneof the remaining buttons, and the process is repeated for that secondselected button.

FIG. 13 shows a GUI editor screen prompting the administrator to selectanother one of the buttons after the second button is assigned to, forexample, the next best seller. After the third button is selected, theGUI editor prompts the administrator to assign the selected button to aproduce item or generic category, as shown for example in FIG. 12.

For example, if “A Specific Produce item” is selected (step 130), theadministrator is prompted to enter a PLU code of the item to he assignedto the selected button (step 132). The Image corresponding to theentered PLU code appears in a portion of the GUI editor screen, as shownfor example by the image of the banana in FIG. 14.

As shown for example in FIG. 15, an organic fruit or vegetables can beselected by specifying its corresponding PLU code.

The administrator may confirm that the image that appears in the GUIeditor screen should be assigned to the button by pressing the displayedimage (steps 134, 136 and 137). On the other hand; if the wrong code wasentered (step 134), the administrator may select “CLEAR” to enter thePLU code again (step 138). if the PLU code entered by the administratoris not valid (step 135), the GUI editor displays a message that theimage is not on file, as shown for example in FIG. 16, and disables the“OK” button. Under this circumstance, the GUI editor waits for the“CLEAR” key to be selected and a valid PLU code to be entered,

Next, a fourth button to be defined may be selected from the mainscreen, as shown for example in FIG. 17. After a fourth button isselected, the screen for selecting an item or generic category, as shownfor example in FIG. 12, again is presented by the GUI editor.

For example, “A Generic Produce Category” button may be selected (step140). The generic category, options include, as shown for example inFIG. 18, assigning a generic category to the selected button, orcreating a submenu of other buttons to be linked to the category button,if the administrator chooses to assign the button to a generic category(step 141), the GUI editor prompts the administrator to select one of anumber of generic categories (e.g., Apples) displayed on the screen(step 142), as shown for example in FIG. 19. When the administratorselects one of the generic categories, the selected button is set to theselected category (step 144)

Next, the GUI editor prompts the administrator to select a fifth buttonto be defined, as shown for example in FIG. 20. After a fifth button isselected, the GUI editor prompts the administrator to select an item orgeneric category to the selected button, as show for example in FIG. 12.For example, this button, like the previous, may be assigned to ageneric category. Then, the GUI editor prompts the administrator toeither

(1) assign a generic category to the button or (ii) create a submenu ofother buttons to be linked to the button, as shown for example in FIG.18.

The option to create a submenu for this button may be selected, and thenspecific items may he assigned to buttons in the submenu, if the optionto create a submenu is selected (step 141), the GUI editor prompts theadministrator to select a button in the submenu (step 146), as shown forexample in FIG. 21, Next, the GUI editor prompts the administrator toenter a PLU code of the item to be assigned to the selected button (step148). When the PLU code is entered, the image corresponding to theentered PLU code appears in a portion of the GUI editor screen, as shownfor example in FIG. 22. The administrator may confirm that the imagethat appears in the GUI editor screen should be assigned to the buttonin the submenu, by pressing the displayed image (step 150). The selectedbutton in the submenu then is set to the selected item corresponding tothe entered PLU code (step 151). If a mistake is made (step 149), the“CLEAR” button may be selected (step 152) and a correct PLU code entered(step 148).

This process may be repeated, as shown, for example in FIGS. 23 and 24,until all buttons in the submenu have been assigned to items. The “EXIT”button may be selected when the process is complete.

Let's now return to the GUI editor screen shown in FIG. 20. One of thealready assigned buttons may be selected. After one of the assignedbuttons (e.g., button assigned to the “Apples” category) is selected,the GUI editor screen shown in FIG. 12 is presented. If theadministrator attempts to assign the button to another item or category,a warning screen, as shown for example in FIG. 25, appears. If thealready assigned button corresponds to a generic category with apre-defined submenu, all the information stored concerning the submenucould be lost if the “YES” button is selected.

Let's return again to the GUI editor screen shown in FIG. 20. After oneof the assigned buttons is selected, the GUI editor screen shown in FIG.12 again is presented. The administrator may choose to “Remove thisButton” to delete the selected button. If the administrator chooses to“Remove this Button” a confirmation screen appears, as shown for examplein FIG. 28. The “YES” button may be selected to confirm the deletion.The “Go Back” button may be selected to return to the edit optionsscreen (i.e., FIG. 7), and then the “Go Back” button may be selectedagain to exit the GUI editor and return to the custom setup screen(i.e., FIG. 6), and a third time to return to the maintenance modescreen (i.e., FIG. 3).

FIG. 27 illustrates how the GUI for non-bar coded items created by theeditor process described above might look on the touch screen of aself-checkout terminal. After a customer selects the apples genericcategory button, the GUI screen shown in FIG. 28 is displayed.

In some implementations, the system database may be customized on aper-store basis so that only items sold by the particular store aredisplayed to the consumer. FIG. 37 shows an interface allowing a storemanager to customize the items that may be selected by the user. In theexample of FIG. 37, the store manager has selected the default “lettuce”type database and may select particular varieties of lettuce in thesystem's database. If the standard database does not contain, aparticular product sold by a store, a new icon can be created by thesystem administrator (e.g., by importing a bitmap file or by capturingan image using the camera 306).

Various changes and modifications of the described embodiments could beeffected by one skilled in the art without departing from the spirit orscope of the invention recited in the appended claims. For example,database 303 may be a local database dedicated to a particular checkoutterminal or a remote database shared by terminals and other storesystems, and may be a hard-disk or in-memory database or data structure,and although use for the checkout of supermarket produce items isdescribed, the self-checkout system may be adapted for other retailenvironments such as the checkout of non-bar-coded hardware items in ahardware store. Improvements and modifications which become apparent topersons of ordinary skill in the art after reading this disclosure, thedrawings and the appended claims are deemed within the spirit and scopeof the present invention, it is therefore contemplated that the appendedclaims would cover any such modifications or improvements.

1. A product purchasing method at a point-of-sale self-checkout terminalcomprising an image capture device and a touch-sensor customer inputdevice for receipt of data from a customer, the product purchasingmethod comprising: capturing an image of a checkout item; processing theimage using image recognition technology to establish a preliminaryidentification of the checkout item; displaying a grouping of itemimages on the touch-sensor customer input device based on thepreliminary identification; receiving from the user a touch input of anitem image at the touch-sensor customer input device identifying an itemimage for purchase from the grouping of item images; and generating analert signal when the identification entered by the user and thepreliminary identification do not match.
 2. The method of claim 10wherein generating the alert signal comprises transmitting an image ofthe checkout item to a supervisor station.
 3. A computer-implementedmethod of configuring a point-of-sale self-checkout terminal system, themethod comprising: initiating a configuration mode upon entry of anadministration password; receiving administer input to configure abest-seller product database by defining a generic group comprising aplurality of products and to configure the database to determine a salesfrequency associated with the generic group based on an aggregate ofsales of the plurality of products in the group and to display aninitial group of interactive icons based on the generic group.
 4. Themethod of claim 12 wherein configuring the product database furthercomprises configuring a update frequency parameter, said updatefrequency parameter determine a period between changes to a display ofselection icons on a user interface viewed by a self-checkout customer.5. The method of claim 12 further comprising propagating changes in theconfiguration data to a plurality of other self-checkout systems.
 6. Aproduct purchasing method comprising: at a point-of-sale self-checkoutterminal comprising a code reader device for automated entry of aproduct identification code present on items for purchase and a customerinput device for receipt of data from a customer, receiving from aself-checkout customer a first input at the customer input deviceinitiating a purchase of an item non-scannable by the reader device;receiving from a purchaser successive ones of a plurality ofalpha-numeric characters; querying a database based on the receivedplurality of alpha-numeric characters to determine a query resultindependent of the relative ordering of the plurality of alphanumericcharacters comprising one or more products identified based on a matchbetween the entered alpha-numeric characters and keywords associatedwith the identified products; displaying to the purchaser a graphicaluser interface comprising a plurality of icons, each icon depicting oneof the products identified in the query result; receiving from thepurchaser a selection of one of the displayed icons; and recording apurchased transaction for an item associated with the selected icon. 7.The method of claim 15 wherein for a first one of a plurality of stems,the database comprises a plurality of keywords; and determining based onthe match comprises comparing the identified alphanumeric characters toeach of the keywords associated with the first one of the items anddetermining that the first item is a matching item when thealpha-numeric characters received from the purchaser match an initialsegment of any of the plurality of keywords.
 8. The method of claim 15further comprising: updating the display of icons as successive ones ofthe plurality of alpha-numeric characters are entered so as to maintaina match between the entered alpha-numeric characters and the displayedicons.
 9. The method of claim 17 wherein refining the display comprisesre-querying the database as successive ones of the plurality ofalpha-numeric character are received.
 10. A method of self-checkoutimplemented by a point-of-sale self-checkout terminal, the methodcomprising: receiving from a user at the self-checkout terminal an inputinitiating a purchase of a non-bar-coded item; receiving from the useran audio input; querying a database based on the received audio input todetermine a query result, the query result comprising one or moreidentified products based on a match between the processed audio inputand keywords associated with the identified one or more products;displaying to the purchaser a graphical user interface comprising aplurality of icons, each icon depicting one of the product basedidentified in the query result; receiving from the purchaser a selectionof one of the displayed icons, and processing a purchase transaction forthe identified item.
 11. The method of claim 19 wherein processing theaudio input comprises processing using a speaker-independent voicerecognition algorithm.
 12. A point-of-sale self-checkout terminalcomprising: a code reader device for automated entry of a productidentification code present on terns for purchase; a customer inputdevice for receipt of dais from a customer; a database comprising storeddata indicating expectation of purchase of items; a video display; aprocessor coupled to the code reader, the input device, the database,and the video display and a memory comprising stored instructions toconfigure the processor to: receive from the self-checkout customer afirst input at the customer input device to initiate a purchase of anitem non-scannable by the reader device; query the database to identifya first plurality of items based on the first input; in response to thefirst input, display to the customer on the video display a graphicaluser interface comprising a first plurality of user-selectable iconseach of said icons representing one of the first plurality of items;receive from the user a second input selecting one of the firstplurality of icons; and process a purchase transaction for an itemcorresponding to the selected icon.